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Abstract This paper presents a canonical dual method for solving a quadratic 
discrete value selection problem subjected to inequality constraints. The prob- 
lem is first transformed into a problem with quadratic objective and 0-1 in- 
teger variables. The dual problem of the 0-1 programming problem is thus 
constructed by using the canonical duality theory. Under appropriate con- 
ditions, this dual problem is a maximization problem of a concave function 
over a convex continuous space. Numerical simulation studies, including some 
large scale problems, are carried out so as to demonstrate the effectiveness and 
efficiency of the method proposed. 

Keywords Discrete value selection ■ Integer programming • Canonical dual • 
0-1 programming 



1 Introduction 

Many decision making problems, such as portfolio selection, capital budgeting, 
production planning, resource allocation, and computer networks, can often 
be formulated as integer programming problems. See for examples, (Chen et 
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al 2010; Floudas 2000; Karlof 2006). In engineering applications, the variables 
of these optimization problems can not have arbitrary values. Instead, some 
or all of the variables must be selected from a list of integer or discrete val- 
ues for practical reasons. For examples, structural members may have to be 
selected from selections available in standard sizes, member thicknesses may 
have to be selected from the commercially available ones, the number of bolts 
for a connection must be an integer, the number of reinforcing bars in a con- 
crete member must be an integer, etc (Huang and Arora 1997). However, these 
integer programming problems are computationally highly demanding. Nev- 
ertheless, some numerical methods are now available. 

Several review articles on nonlinear optimization problems with discrete 
variables have been recently published (Arora et al. 1994; Loh and Papalam- 
bros 1991; Samdgren 1990; Thancdar and Vanderplaats 1994), and some pop- 
ular methods have been discussed, including branch and bound methods, a 
hybrid method that combines a branch-and-bound method with a dynamic 
programming technique (Marsten and Morin 1978), sequential linear program- 
ming, rounding-off techniques, cutting plane techniques (Balas et al. 1993), 
heuristic techniques, penalty function approach and sequential linear program- 
ming. The relaxation method has also been proposed, leading to second order 
cone programming (SOC) (Ghaddar et al. 2011). More recently, simulated 
annealing (Kincaid and Padula 1990) and genetic algorithms have been dis- 
cussed. 

Branch and bound is perhaps the most widely known and used method for 
discrete optimization problems. When applied to linear problems, this method 
can be implemented in a way to yield a global minimum point; however, for 
nonlinear problems there is no such guarantee, unless the problem is convex. 
The branch and bound method has been used successfully to deal with prob- 
lems with discrete design variables, however, for the problem with a large 
number of discrete design variables, the number of subproblcms (nodes) be- 
comes large, making the method inefficient. 

Simulated annealing (SA) is a stochastic technique to find a global mini- 
mizer. The basic idea of the method is to generate a random point and evaluate 
the problem functions. If the trial point is feasible and the cost function value 
is smaller than the current best record, the point is accepted, and record for 
the best value is updated. The acceptance is based on value of the probability 
density function. In computing the probability a parameter called the temper- 
ature is used. Initially, a larger target value is selected. As the trials progress, 
the target value is reduced (this is called the cooling schedule), and the process 
is terminated after a fairly large number of trials. The main deficiency of the 
method is the unknown rate at which the target level is to be reduced and 
uncertainty in the total number of trials. 

Genetic algorithms (GA) belong to the category of stochastic search meth- 
ods (Holland 1975). In a GA, several design alternatives, called a population 
in a generation, are allowed to reproduce and cross among themselves, with 
bias allocated to the most fit members of the population. Three operators are 
needed to implement the algorithm: reproduction, crossover, and mutation. 
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These three steps are repeated for successive generations of the population 
until certain stopping criteria are satisfied. The member in the final genera- 
tion with the best fitness level is the optimum design. 

The SA method and GA usually need large execution times to find a global 
minimum. Although it is possible to find the best solution if temperature is 
reduced slowly and enough execution time is allowed. A drawback of SA is 
lack of an effective stopping criterion. It is difficult to tell whether a global 
or fairly good solution has been reached. It is also important to note that the 
CPU times for SA and GA can vary from one run to the next for the same 
problem (Huang and Arora 1997). 

Canonical duality theory provides a new and potentially useful methodol- 
ogy for solving a large class of integer programming problems. It was shown 
in (Gao 2007 and Fang et al 2008) that the Boolean integer programming 
problems are actually equivalent to certain canonical dual problems in contin- 
uous space without duality gap, which can be solved deterministically under 
certain conditions. This theory has been generalized for solving multi-integer 
programming and the well-known max cut problems (see Wang et al 2008 and 
Wang et al 2012). It is also shown in (Gao 2009, Gao and Ruan 2010) that 
by the canonical duality theory, the NP-hard quadratic integer programming 
problem can be transformed to a continuous unconstrained Lipschitzian global 
optimization problem, which can be solved via deterministic methods (see Gao 
et al 2012). 

In this paper, our goal is to solve a general quadratic programming problem 
with its decision variables taking values from discrete sets. The elements from 
these discrete sets are not required to be binary or uniformly distributed. An 
effective numerical method is developed based on the canonical duality theory 
(Gao 2000). The rest of the paper is organized as follows. Section 2 presents 
a mathematical statement of the problem. Section 3 shows that this general 
discrete- value quadratic programming problem can be transformed into a 0-1 
programming problem in higher dimensional space. In Section 4, the canonical 
duality is utilized to construct the canonical dual problem. The computational 
method, which is based on solving the canonical dual problem, is developed. 
Some numerical examples are illustrated to demonstrate the effectiveness and 
efficiency of the proposed method. The paper is ended with some concluding 
remarks. 



2 Discrete Programming Problem 

The discrete programming problem to be addressed is given below: 

(P a ) Minimize P(x) = ^x T Qx - c T x (1) 

subject to g(x) = Ax — b < 0, (2) 

x = [xi,x 2 , ■ ■ ■ ,x n ] T , i, e C/„ i = !,-•■, n, 



4 



Ning Ruan and David Y. Gao 



where Q — {qij} G M.™ x " is an n x n positive semi-definite symmetric ma- 
trix, A = {dij} G ^mxn i s a n m x n matrix with rank(A) — m < n, 
c = [ci, • • ■ , c„] T G K" and b = [61, • • ■ , 6 m ] T G IR m are given vectors. Here, 
for each i = 1, • ■ • ,n, 

where, = 1, • • • , Ki, are given real numbers. Let K — Y^i=i ^-i- 

3 Equivalent Transformation 

Let us introduce the following transformation, 

Ki 



i=i 



(3) 



where, for each i = l,---,n, Mjj G f/j, j = 1, Then, the discrete 
programming problem (P a ) can be written as the following 0-1 programming 
problem: 

(V b ) Minimize P(y) = \y T By - h T y (4) 

subject to g(y) = Dy — b < 0, (5) 

^Vij - 1 = 0, i = 1, • • • ,n, (6) 

Vij G {0, 1}, i = 1, . . . , n; j = 1, • • • , K h (7) 



where 



y = [yi,i, - ■ ■ ,yi,K!, - ■ • ,y n ,i, - ■ ■ ,Vn,K n ] T e M K , 



h= [ciMi4,---,ciUi^ 1 ,---,c„u„ 4 ,---,c„M„ i _ ft : ?l ] T G R K , 



D 



• • • 91, 1"!, 1^1,^1 ' ' ' Ql,nUl,lUn,K. 



9n,lMn,/f„Wl,l • • • 



<>KxK 



D = 



Ol,l«l,l • • • Ol.lUl.Jfi • • • CLl,nUn,K n 



«m,lMl,l • • • Ct TO; lUl ; Ki • • • a>m,nUn,K„ 



T>mxK 
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Theorem 1 Problem (Vb) is equivalent to Problem (V a ). 



Proof. For any i = 1,2, ■■■,n, it is clear that constraints ([6]) and ([7]) are 
equivalent to the existence of only one j £ {1, • • ■ , Ki}, such that jjij = 1 
while yi.j — for all other j. Thus, from the definition of y, the conclusion 



follows readily. 
Let 



□ 



H 



1 
1 



••• 00 







1 



1 



ixK 



niV 



and, for any integer TV, let 

ejv = [1, • • - • • • ,1, 
We consider the following quadratic programming problem: 

(V) Minimize P(y) = iy T By - h T y 

subject to g(y) = Dy — b < 0, 
Hy - e„ = 0, 
y ° (y - e K ) < 0, 



(8) 
(9) 
(10) 
(11) 



where the notation sot := [siii, 52^2, • ■ • , SK~tK] T denotes the Hadamard prod- 
uct for any two vectors s, t e R K . 



4 Canonical duality theory: A brief review 

The basic idea of the canonical duality theory can be demonstrated by solving 
the following general nonconvex problem (the primal problem (V) in short) 

(P): miniP(x) = hx,Ax)-(x,f} + W(x)\, (12) 

x£X a ^2 J 

where A e R™ xn is a given symmetric indefinite matrix, f G M™ is a given 
vector, (x,x*) denotes the bilinear form between x and its dual variable x* , 
X a C K" is a given feasible space, and W : X a — » RUoo is a general nonconvex 
objective function. The mathematical definition of the objectivity for general 
functions is given in (Gao, 2000). 

The key step in the canonical dual transformation is to choose a nonlinear 
operator, 



£ = A(x) : X a -> £ a C R p 



(13) 
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and a canonical function V : £ a — > M such that the nonconvex objective 
function W(x) can be recast by adopting a canonical form W(x) = V^(^l(x)). 
Thus, the primal problem (V) can be written in the following canonical form: 

(V): min{P(x) = y(^(x))-C/(x)}, (14) 

where U{~x) — (x, f) — -|(x, Ax). By the definition introduced in (Gao 2000), a 
diffcrcntiable function V{e) is said to be a canonical function on its domain £ a 
if the duality mapping <; = \7V(e) from £ a to its range S a C W is invertiblc. 
Let (e; <;} denote the bilinear form on W . Thus, for the given canonical function 
V(e), its Legendre conjugate V*(s) can be defined uniquely by the Legendre 
transformation 

K*(0 = sta{( £ ; s > - V{e) \ e e £ a }, (15) 

where the notation sta{g(e)| e G £ a } stands for finding stationary point of 
g(e) on £ a . It is easy to prove that the following canonical duality relations 
hold on £ a x S a : 



? = W(e) e = W*(0 K(e) + V*(s) = (e; (16) 

By this one-to-one canonical duality, the nonconvex term W(x) = V(A(x)) 
in the problem (V) can be replaced by (A(x);<;) — V*(s) such that the non- 
convex function P(x) is reformulated as the so-called Gao and Strang total 
complementary function (Gao 2000): 

= (A(x);<;)-V*(<;)-U(x). (17) 

By using this total complementary function, the canonical dual function P d (s) 
can be obtained as 

P d (0 = sta{ S (x,0 |xe<Y a } 

= ^(?)-^*(0, (18) 

where U A (x) is defined by 

U A {<;) = sta{(/l(x); s > - C/(x) | x e #„}. (19) 

In many applications, the geometrically nonlinear operator A(x) is usually 
quadratic function 

A(x) = l(x,D fc x) + (x,b fc ), (20) 

where D fc £ K" x ™ and b fe e R"(fc = 1, • • • ,p). Let <; = [ft, • • • ,? P ] T . In this 
case, the canonical dual function can be written in the following form: 

P d (<;) = - 1 -(F^),G(^))-V*(^ (21) 



Discrete Value Selection Problem 



7 



where G(<r) = A + J2l=i SkD k , and F(?) = f £)£ =1 ^h k . 

Let 5+ = G R p | >r 0}. Therefore, the canonical dual problem can 
be proposed as 

(T d ) : max{P d (^)| c £l S+}. (22) 

which is a concave maximization problem over a convex set 5+ c R p . 

Theorem 2 (Gao 2000) Problem (V d ) is canonically dual to (V) in the 
sense that if <z is a critical point of II d (<;), then 

x = Gt(?)T® (23) 

is a critical point o/77(x) and 

P(x) = S(x,5) = P d (^). (24) 
is a solution to (V d ), then 5t is a global minimizer of (P) and 

min P(x) = S(x, = max P rf «). (25) 

Conversely, if x is a solution to (P), it must be in the form of A23\) for critical 
solutions of II d (<i). 

To help explain the theory, we consider a simple nonconvex optimization 
in M" : 

minil(x) = I a (I|| x || 2 - A) 2 - x T f, Vx e R™, (26) 

where a, A > are given parameters. The criticality condition VP(x) = 
leads to a nonlinear algebraic equation system in R™ 

a(i||x|| 2 -A)x = f. (27) 

Clearly, to solve this n-dimensional nonlinear algebraic equation directly is 
difficult. Also traditional convex optimization theory can't be used to identify 
global minimizer. However, by the canonical dual transformation, this problem 
can be solved. To do so, we let £ = A(u) = ^\\x\\ 2 - A S R. Then, the 
nonconvex function W(x) = ^a(^||x|| 2 — A) 2 can be written in canonical form 
V(£) = \a^ 2 . Its Legendre conjugate is given by V*(?) = |a -1 ? 2 '', which is 
strictly convex. Thus, the total complementary function for this nonconvex 
optimization problem is 

S(x, = (i||x|| 2 - A), - ~a"V - x T f. (28) 

For a fixed ? £ R, the criticality condition V x S'(x) = leads to 

?x - f = 0. (29) 




For each ? ^ 0, the equation (f2T)| gives x = f/<j in vector form. Substituting 
this into the total complementary function E, the canonical dual function can 
be easily obtained as 

i7 rf (0 = {^(x,0|V x »(x,0 = 0} 

= -^--^-V-A^, V?^0. (30) 

The critical point of this canonical function is obtained by solving the following 
dual algebraic equation 

{a-\ + \)e = \t T i. (31) 

For any given parameters a, A and the vector f 6 R™, this cubic algebraic 
equation has at most three roots satisfying ft > > ft > <;3 , and each of these 
roots leads to a critical point of the nonconvex function -P(x), i.e., x^ = f/?i, 
2 = 1,2, 3. By the fact that ft e S+ = {c € K | <r > 0}, then Theorem 1 tells 
us that Xi is a global minimizer of II (x). Consider one dimension problem 
with a = l,A = 2,/ = i, the primal function and canonical dual function are 
shown in Fig.[TJ where, x% = 2.11491 is global minimizer of P(x), ft = 0.236417 
is global maximizer of II d (<;), and II {x\) — —1.02951 = iJ d (ft) (See the two 
black dots). 

The canonical duality theory was original developed from general noncon- 
vex systems. The canonical dual transformation can be used to convert a non- 
convex problem into a canonical dual problem without duality gap, while the 
classical dual approaches may suffer from having a potential gap (Rockafcllar 
1987). The complementary-dual principle provides a unified form of analytical 
solutions to general nonconvex problems in either continuous or discrete sys- 
tems. The canonical duality theory has shown its potential for various classes 
of challenging problems. A comprehensive review of the canonical duality the- 
ory and its applications can be found in (Gao and Ruan 2008; Gao and Ruan 
2010; Gao et al. 2012; Gao et al. 2009; Gao et al. 2010; Ruan et al. 2010). 
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5 Canonical Dual Problem 

Now we apply the canonical duality theory to integer programming problem 
presented in Section 2. 
Let 

U(y) = -P(y) = h T y - \y T By, 



and define 



z = A{y) = [(Dy b) T , (Hy e n f , (y o (y - e K )) T f 
= l(e) T ,(S) T ,(pf] T £^ m+n+K , 



where A is the so-called geometric operator. Let 
W(z) 



if e < 0,<5 = 0,p < 0, 
+oo otherwise. 

Let z* = [(<t) t , (t) t , (p) T ] T £ K m+n+ * : be the canonical dual variables cor- 
responding to those from the set Z = {(e, d, p) : e < 0, S = 0, p < 0}. Then, 
the Fenchel super-conjugate of the function W(z) is defined by 



W s (z*) = sup{z T z* - W{z) : ze Z} 

ifer>0,/x>0, 
+oo otherwise. 



(32) 



Let 

G{p) = B + 2Diag (/x), (33) 

and 

F(tr,T,n) = h- D T (T - H t t + p. (34) 
Then, the total complementary function can be obtained as: 
E(y,v,T,ri = (A(y),z*) - W^(z*) - U(y) 

= ±y T By - h T y + <x T '(Dy - b) 

+r T (Hy - e„) + p T (y o (y - e K )) 
= \y T By + iy T (2Diag (p))y - h T y 

(D T a) T y - p T y + (H T r) T y - a T h - r T e n 
= ^y T G(^)y - F T (cr, r, p)y - er T b - r T e„. 

The critical condition V y S'(y, er, r, p) = leads to 

y = G\p)F{a,r,p), (35) 
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where G'(p) denotes the Moore- Penrose generalized inverse of G(p) = (B + 
2Diag (/*)). 

The canonical dual problem can be stated as follows: 

(T d ) Maximize P d {<r, r, p) = —jF{a, r, p) T G\p)F(a, r, /x) - cr T b - r T e„ 

subject to <t > 0, /x > 0, 

a G K. m , r G l",/j£ M A ". 

Theorem 3 (Complementary-Dual Principle) Problem (V ) is a canon- 
ically dual to Problem (P) in the sense that if (cr, t, p) is a KKT solution of 
Problem (V d ), then the vector 

y(tr,T,p) = &(ji)F(ir,T,p) (36) 

is a KKT solution of Problem (V) and 

P{y)^P d {a 1 T,fi). 

Moreover, if (&, t, ft) is a critical point of Problem (V d ) and fi > 0, then 
y is a critical point of Problem (P). 

Proof. By introducing the Lagrange multiplier vector e < G M. m , 8 G R", 
and p < G M. K , the Lagrangian function associated with the dual function 
P d (cr, t, /j,) becomes 

L(cr, t , /x, e, S, p) = P d (cr, t, /x) — e T er + S t t — p T p. 

Then, the KKT conditions of the dual problem become 

dL(cr, t, p, e, 8, p) 



da- 

dL(a,T,p,e,6,p) 
dr 

dL(a,T,p,e,6,p) 
dp 

a > 0,e < 0,a T e = 0, 
P > 0,p < o,p T p = 0. 



Dy - b - e = 0, 
Hy - e„ + 6 = 0, 
y o (y - ejf) - p = 0, 



They can be written as: 

Dy < b, (37) 

Hy - e n = 0, (38) 

y(y-ex)<0, (39) 

cr > 0,a T (Dy - b) = 0, (40) 

A*>0,/x T (yo(y- e/< )) = 0. (41) 

Specifically, if p > 0, the complementary condition leads to y o (y — &k) = 0. 

This proves that if (a-,r,p) is a KKT solution of (V d ), then ([3T | -([59 l is 
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the so-called primal feasibility condition, while (|4T))) - (l4"TT) is the so-called dual 
feasibility condition and complementary slackness condition. Therefore, the 
vector 

y(o-,T,/x) = G^(p,)F(&,T,fi) 

is a KKT solution of Problem (V). 

Again, by the complementary condition and (|36p . we have 

P d (<r, r, fi) = ~F(tr, t, ^) t G{t^F{ct, t, h) - rr T h - r T e„ 

= \y TB y - hT y + ^Py - b ) + T ( H y - e «) + **(y ° (y - e*)) 

= iy T i?y-h T y = P(y). 

□ 

To continue, let the feasible space y of problem (V) and the dual feasible 
space Z be defined by 

y={yeR K :Dy< b, Hy = e„, y o (y - e K ) < 0} 

and 

Z = {(<t, t, n) G K m x W 1 x R K : a > 0, fi > 0, F(&, t, ft) G C oJ (G?(/i))}, 

respectively, where C ;(G(/x)) denotes the linear space spanned by the columns 
of G(p). 

We introduce a subset of the dual feasible space: 

Z+:={(tr,T,^)eZ:G(n)i~0}. (42) 
We have the following theorem. 

Theorem 4 Assume that (&,T,fi) is a critical point of P d (<r , t , ^t) and y = 
G^{ft)F{or, t, ju). J/ {&,T,fi) G Z+, £/ien y is a global minimizer of P(y) and 
(&,T,fi) is a global maximizer of P d (cr,T, fi) with 

P(y) =minP(y) = max P<V, t, m) = ^V, t, A) (43) 
yey (a-,T,fj,)ez+ 

Proof 

The canonical dual function P d (cr,r,/x) is concave on Z+. Therefore, a 
critical point (<r, t, ju) G i?+ must be a global maximizer of P d (er,T,fj,) on 
For any given (<r, t, /x) G the complementary function H(y, cr, r, /it) 
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is convex in y and concave in (<x, r, fx), the critical point (y, <x, r, /it) is a saddle 
point of the complementary function. More specifically, we have 

P d (d-,T,fi)= max P d (a,T,fi) 
(<r,T,fJ,)ezt 

= max min £(y, <x, r, /Lt) = min max H(y, <x, r, /Li) 

= min max {-y T G(/i)y — (h — D T er — i? T r + /i) T y 
ye^ ((t,t,h)gz+ 2 

-er T b - T T e„} 

.1 

ye? (<t,t,/x)g2+ 1 2' 
+r T {Hy - e„) + /x T y o (y - e K )} 

min max {— y T By — h T y + (z*) T z} 
yey (a,T,fj,)eZ+ 2 



nun max {-y T £>y — h T y + cr T (Dy — b) 



Note that 



and 



max {W tt (z*)} = 

2*<£Z+ 



max{W(z)} = 0. 



Thus, it follows from flSJ that 

P d {a,f,fl) = min max {^y T Sy - h T y + (z*) T z - W^z*)} 
y&y ((T,T,fi)ez+ 2 

= min{~y T .By - h T y} + max {(z*) T z - W B (z*)} 
y& 2 (cr,T,u)ez+ 



I 



iam{^y T J By-h T y}+ max {(z*) T z - z T z* + W(z)} 



= m in{^y T Sy - h T y} 
= min P(y). 

This completes the proof. □ 



6 Numerical Experience 

All data and computational results presented in this section are produced by 
Matlab. In order to save space and fit the matrix in the paper, we round our 
these results up to two decimals. 

Example 1. 5-dimensional problem. 
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Consider Problem (V a ) with x 
l,---,5, 



[xi, • • • , x 5 ] T , while Xi <E {2,3,5}, 



Q 



3.43 0.60 0.39 0.10 0.60 
0.60 2.76 0.32 0.65 0.49 
0.39 0.32 2.07 0.59 0.39 
0.10 0.65 0.59 2.62 0.30 
0.60 0.49 0.39 0.30 3.34 



c = [38.97, -24.17,40.39, -9.65, 13.20] T , 



0.94 0.23 0.04 0.65 0.74 
0.96 0.35 0.17 0.45 0.19 
0.58 0.82 0.65 0.55 0.69 
0.06 0.02 0.73 0.30 0.18 



b = [11.49, 9.32, 14.43, 5.66] T . 

Under the transformation ©, this problem is transformed into the 0-1 pro- 
gramming Problem (V), where 

y = [yi,i,yi,2,yi,3, ■ ■ -,2/5,1, 2/5, i,2/5,3] T e k 15 , 



13.71 


20.56 


34.27 


2.40 


3.61 


20.56 


30.84 51.41 


3.61 


5.41 


34.27 51.41 


85.68 


6.01 


9.01 


2 


40 


3.61 


6.01 


11.05 


16.57 


3 


61 


5.41 


9.01 


16.57 24.85 


6 


01 


9.01 


15.02 


27.61 


41.42 


1 


58 


2.37 


3.95 


1.27 


1.91 


2 


37 


3.55 


5.92 


1.91 


2.86 


3 


95 


5.92 


9.87 


3.18 


4.77 





39 


5.58 


0.97 


2.61 


3.91 





58 


0.88 


1.46 


3.91 


5.87 





97 


1.46 


2.43 


6.52 


9.78 


2 


38 


3.57 


5.95 


1.95 


2.93 


3 


57 


5.36 


8.93 


2.93 


4.39 


5 


95 


8.93 


14.88 


4.88 


7.32 



6.01 1.58 2.37 3.95 0.39 

9.01 2.37 3.55 5.92 0.58 

15.02 3.95 5.92 9.87 0.97 
27.61 1.27 1.91 3.18 2.61 
41.42 1.91 2.86 4.77 3.91 

69.03 3.18 4.77 7.96 6.52 
3.18 8.27 12.40 20.67 2.37 

4.77 12.40 18.60 31.00 3.55 
7.96 20.67 31.00 51.67 5.92 
6.52 2.37 3.55 5.92 10.50 

9.78 3.55 5.33 8.89 15.74 
16.31 5.92 8.89 14.81 26.24 
4.88 1.57 2.36 3.93 1.20 
7.32 2.36 3.54 5.90 1.80 
12.20 3.93 5.90 9.83 3.00 



0.58 0.97 2.38 3.57 5.95 " 

0.88 1.46 3.57 5.36 8.93 

1.46 2.43 5,95 8.93 14.88 

3.91 6.52 1.95 2.93 4.88 

5.87 9.78 2.93 4.39 7.32 

9.78 16.31 4.88 7.32 12.20 

3.55 5.92 1.57 2.36 3.93 

5.33 8.89 2.36 3.53 5.90 

8.86 14.81 3.93 5.90 9.83 

15.74 26.24 1.20 1.80 3.00 

23.62 39.36 1.80 2.70 4.50 

39.36 65.60 3.00 4.50 7.51 

1.80 3.00 13.35 20.02 33.37 

2.70 4.50 20.02 30.04 50.06 

4.50 7.51 33.37 50.06 83.43. 



h = [77.95, 116.92, 194.87, -48.34, -72.51, -120.85, 80.78, 121.17 
201.96, -19.29, -28.94, -48.23, 26.39, 39.59, 65.99] T , 



" 1.88 2.83 4.71 

1.91 2.87 4.78 

1.15 1.72 2.88 

. 0.12 0.18 0.30 



0.47 0.70 1.17 

0.71 1.06 1.77 

1.64 2.46 4.11 

0.03 0.05 0.08 



0.09 0.12 0.22 

0.34 0.51 0.85 

1.30 1.95 3.25 

1.46 2.20 3.66 



1.30 1.94 3.24 

0.90 1.35 2.25 

1.09 1.64 2.74 

0.59 0.89 1.48 



1.49 2.23 3.72" 
0.38 0.57 0.94 
1.37 2.06 3.43 
0.37 0.55 0.92. 



H 



1 ... i o ... ••• ••• 
o ... 1 ■•• 1 ■•• ■•• 



p5x 15 



o ... 00 •••()••• 1 ••• 1 
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The Canonical dual problem can be stated as follows: 

{V d ) Maximize P d (a, r, fi) = ~\f{(t, t, /i) T G t (/i)F(cr, r, /x) - cr T b - r T e 5 



subject to er > 0, zx > 0, 



cr G 



where F(cr,r,fi) and G(/x) are as defined by (|3U)) and (|3"4")l . respectively. 
By solving this dual problem with the sequential quadratic programming 
method in the optimization Toolbox within the Matlab environment, we obtain 

<r = [0,0,0,0] T , 



[73.90, -106.70, 111.95, -59.27, -O.Olf 



and 



/x = [39.34, 22.07, 12.49, 33.56, 3.01, 76.14, 61.00, 35.52 
18.78, 1.47, 41.96, 0.001, 0.001, 0.006] T . 

It is clear that (<r, r, ft) G Z+. Thus, from Theorem [H 

y = (B + 2Diag (/i)) t (h - D T a - H t t + p,) 
= [0,0,1,1,0,0,0,0, 1,1, 0,0, 1,0, 0] T 

is the global minimizer of Problem (V) with P d (&,t,p.) = —227.87 = P(y)- 
The solution to the original primal problem can be calculated by using the 
transformation 



A", 



1,2,3,4,5, 



to give 



x= [5,2,5,2,2] 5 



with P(x) = -227.87. 

Example 2. 10-dimensional problem. 

Consider Problem (V a ), with x = \x\, ■ ■ ■ , xio] T , while Xi G {1, 2, 4, 7, 9}, i 
10, 



Q 



6.17 0.62 0. 
0.62 5.63 0. 
0.46 0.29 5. 
0.37 0.56 0. 
0.56 0.79 0. 
0.66 0.29 0. 
0.67 0.43 0. 
0.85 0.69 0. 
0.57 0.49 0. 
0.44 0.39 0. 



46 0.37 
29 0.56 
81 0.55 
55 6.10 
22 0.28 
55 0.42 
36 0.44 
27 0.34 
51 0.75 
91 0.44 



0.56 0. 
0.79 0. 
0.22 0. 
0.28 0. 
4.75 0. 
0.40 5. 
0.55 0. 
0.42 0. 
0.49 0. 
0.44 0. 



66 0.67 
29 0.43 
55 0.36 
42 0.44 
40 0.55 
71 0.32 
32 5.27 
57 0.56 
65 0.37 
70 0.85 



0.85 
0.69 
0.27 
0.34 
0.42 
0.57 
0.56 
5.91 
0.15 4 
0.62 



.57 0.44 
49 0.39 
51 0.91 
75 0.44 
49 0.44 
65 0.70 
37 0.85 
15 0.62 
51 0.46 
46 5.73 
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f = [0.89, 0.03, 0.49, 0.17, 0.98, 0.71, 0.50, 0.47, 0.06, 0.68] 5 



A = 



0.04 0.82 0.97 0.83 0.83 0.42 0.02 0.20 0.05 0.94 
0.07 0.72 0.65 0.08 0.80 0.66 0.98 0.49 0.74 0.42 
0.52 0.15 0.80 0.13 0.06 0.63 0.17 0.34 0.27 0.98 
0.10 0.66 0.45 0.17 0.40 0.29 0.11 0.95 0.42 0.30 
0.82 0.52 0.43 0.39 0.53 0.43 0.37 0.92 0.55 0.70 



b = [33.76, 37.07, 26.75, 25.46, 37.36] T . 
By solving the canonical dual problem of Problem (V a ), we obtain 

a = [0,0, 0,0, of, 



t = [-19.99, -20.12, -18.13, -18.37, -14.32, 
-17.13, -18.46, -19.73, -17.65, -16.55] T , 



and 



ft = [9.51, 0.97, 21.93, 53.36, 74.34, 9.95, 0.21, 20.53, 51.01, 71.35 
8.68, 0.77, 19.68, 48.03, 66.94, 8.30, 1.77, 21.91, 52.13, 72.27 
6.40, 1.54, 17.39, 41.19, 57.04, 7.57, 1.98, 21.10, 49.77, 68.90 
9.15, 0.16, 18.79, 46.72, 65.34, 9.82, 0.09, 19.90, 49.63, 69.45 
8.76, 0.13, 17.92, 44.60, 62.39, 6.26, 4.03, 24.60, 55.48, 76.04] T , 

It is clear that (<x, r, ft) G Z+ . Therefore, 

y = [1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, 
1,0,0,0,0,1,0,0,0,0, 1,0,0,0,0, 1,0,0,0,0, 1,0,0,0,0] T 

is the global minimizer of the problem (P) with P d (cr,f,(i) = 45.54 = P(y). 
The solution to the original primal problem is 

x=[l,l,l,l,l,l,l,l,l,l] T 

with P(x) = 45.54. 

Example 3. Large scale problems. 

Consider Problem (T a ) with n = 20, 50, 100, 200 and 300. Let these 
five problems be referred to as Problem (1), Problem (5), respectively. 
Their coefficients are generated randomly with uniform distribution. For each 
problem, q-ij G (0,1), G (0,1), for i = l,---,n; j = 1, ■•■,n, and Cj G 
(0, 1), Xi G {1, 2, 3, 4, 5}, for i = 1, • ■ • n. Without loss of generality, we ensure 
that the constructed Q is a symmetric matrix. Otherwise, we let Q — ® + ® . 
Furthermore, let Q be such that it is diagonally dominated. For each x i: its 
lower bound is k — 1, and its upper bound is u, = 5. Let I = [Zi, • • • , l n ] T and 
u = [ui, ■ ■ ■ , u n ] T . The right-hand sides of the linear constraints are chosen 
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such that the feasibility of the test problem is satisfied. More specifically, we 
set b = V , aijlj + 0.5 • aijUj - V, <i,,l,). 

We then construct the canonical problem of each of the five problems, 
ft is solved by using the sequential quadratic programming method with ac- 
tive set strategy from the Optimization Toolbox within the Matlab environ- 
ment. The specifications of the personal notebook computer used are: Intel(R), 
Core(TM)(1.20 GHZ), Window Vista(TM). Table 1 presents the numerical re- 
sults, where m is number of linear constraints in Problem I(V a )- 



Table 1 Numerical results for large scale integer programming problems 



From Table 1, we see that the algorithm based on the canonical dual 
method can solve large scale problems with reasonable computational time. 
Furthermore, for each of the five problems, the solution obtained is a global 
optimal solution. For the case of n — 300, the equivalent problem in the form of 
Problem (Vb) has 1500 variables. For such a problem, there are 2 1500 possible 
combinations. 

7 Conclusion 

We have presented a canonical duality theory for solving a general discrete 
value selection problem with quadratic cost function and linear constraints. 
Our results show that this NP-hard problem can be converted to a continuous 
concave dual maximization problem without duality gap. If the canonical dual 
space Z£ is non empty, the problem can be solved easily via well-developed 
convex optimization methods. Several examples, including some large scale 
ones, were solved effectively by using the method proposed. 
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